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, ■ Abstract 

The entropy/influence conjecture, raised by Friedgut and Kalai f8^ in 1996, seeks to relate 
CO i two different measures of concentration of the Fourier coefficients of a Boolean function. 

Roughly saying, it claims that if the Fourier spectrum is "smeared out" , then the Fourier 
coefficients are concentrated on "high" levels. In this note we generalize the conjecture to 
' biased product measures on the discrete cube, and prove a variant of the conjecture for 

. functions with an extremely low Fourier weight on the "high" levels. 

^' . 

^ ■ 1 Introduction 

Definition 1.1. Consider the discrete cube {0, 1}" endowed with the product measure /Xp = 
(^"^{1} + (1 — p)^{o})'^^ ! denoted in the sequel by {0, l}p, and let f : {0, 1}^ — ^ M. The Fourier- 
Walsh expansion of f with respect to the measure fip is the unique expansion 



in 

^ . 

CSl . S'C{l,2,...,n} 

in 
o 



/ = J2 ^sus, 

where for any T C {1, 2, . . . , n}j3 



In particular, for the uniform measure (i.e., p = 1/2), us(T) = (— l)''^'"'"^! . The coefficients as 



^r. are denoted by f{S)E 

and the level of the coefficient f{S) is \S\ 

Properties of the Fourier- Walsh expansion are one of the main objects of study in discrete 
harmonic analysis. The entropy /influence conjecture, raised by Friedgut and Kalai [8j in 1996, 
seeks to relate two measures of concentration of the Fourier coefficients (i.e. coefficients of the 
Fourier- Walsh expansion) of Boolean functions. The first of them is the spectral entropy. 
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Definition 1.2. Let f : {0, l}p — )■ { — 1,1} be a Boolean function. The spectral entropy of f 
with respect to the measure fip is 



sell,...,™} yj^^ 



sc{i,...,n} \fisy 

where the Fourier-Walsh coefficients are computed w.r.t. to fip. 

Note that by Parseval's identity, for any Boolean function we have Y2s fi^)'^ ~ ^^'^ thus, 
the squares of the Fourier coefficients can be viewed as a probabihty distribution on the set 
{0, 1}". In this notation, the spectral entropy is simply the entropy of this distribution, and 
intuitively, it measures how much are the Fourier coefficients "smeared out" . 

The second notion is the total influence. 

Definition 1.3. Let f : {0, l}p — t- {0, 1}. For 1 < i < n, the influence of the i-th coordinate 
on f with respect to jip is 

lf(/)= Pr [f{x)^f{x®e{)i 

where x®ei denotes the point obtained from x by replacing Xi with 1 — Xi and leaving the other 
coordinates unchanged. 

The total influence of the function f is 

w) = Eir(/)- 

i=l 

Influences of variables on Boolean functions were studied extensively in the last decades, 
and have applications in a wide variety of fields, including Theoretical Computer Science, 
Combinatorics, Mathematical Physics, Social Choice Theory, etc. (see, e.g., the survey |10).) 
As observed in [9], the total influence can be expressed in terms of the Fourier coefficients: 

Observation 1.4. Let f : {0, 1}^ {-1, 1}. Then 

In particular, for the uniform measure Hi/2, Ii/2(/) = \S\f{S)'^. 

Thus, in terms of the distribution induced by the Fourier coefficients, the total influence 
is (up to normalization) the expectation of the level of the coefficients, and it measures the 
question whether the coefficients are concentrated on "high" levels. 

The entropy /influence conjecture asserts the following: 

Conjecture 1.5 (Friedgut and Kalai). Consider the discrete cube {0, 1}" endowed with the 
uniform measure There exists a universal constant c, such that for any n and for any 

Boolean function f : {0, l}"y2 ~^ 

Enti/2(/)<c-Ii/2(/). 
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The conjecture, if confirmed, has numerous significant impUcations. For example, it would 
imply that for any property of graphs on n vertices, the sum of influences is at least c(log n)^ 
(which is tight for the property of containing a clique of size ~ log n). The best currently known 
lower bound, by Bourgain and Kalai 0, is il((log n)^""^), for any e > 0. 

Another consequence of the conjecture would be an affirmative answer to a variant of a 
conjecture of Mansour [13] stating that if a Boolean function can be represented by a DNF 
formula of polynomial size in n (the number of coordinates), then most of its Fourier weight is 
concentrated on a polynomial number of coefficients (see [U] for a detailed explanation of this 
application). This conjecture, raised in 1995, is still wide open. 

In this note we explore the entropy/influence conjecture in two directions: 

Biased measure on the discrete cube. We state a generalization of the conjecture to the 
product measure fip on the discrete cube: 

Conjecture 1.6. There exists a universal constant c, such that for any < p < 1, for any n 
and for any Boolean function f : {0, l}p — )• { — 1, 1}, 

Entp(/)<cplog(l/p)-Ip(/). 

We prove that Conjecture 11.61 follows from the original Entropy /Influence conjecture, and 
that it is tight for the graph property of containing a clique of fixed size (at the critical proba- 
bility). This answers a question raised by Kalai [11 j. 

Functions with a low Fourier weight on the "high" levels. We consider a weaker version 
of the conjecture stating that if "almost all" the Fourier weight of a function is concentrated 
on the lowest k levels, then its entropy is at most c • k. We prove this statement in an extreme 
case: 

Proposition 1.7. Let f : {0, l}"/2 ~^ Boolean function such that all the Fourier 

weight of f is concentrated on the first k levels. Then all the Fourier coefficients of f are of the 
form 

f{S) = aiS) ■ 2-^ 

where a{S) € Z. In particular, Enti/2(/) ^ 

Then we cite a stronger unpublished result of Bourgain and Kalai ^ which shows that if the 
Fourier weight beyond the A;th level decays exponentially, then the spectral entropy is bounded 
from above by c • A;. 

Finally, we suggest that if one could generalize the result of Bourgain and Kalai to some 
slower rate of decay, this would lead to a proof of the entire entropy/influence conjecture, using 
a tensorisation technique. 

This note is organized as follows. In Section [2] we consider the generalization of the en- 
tropy/influence conjecture to the biased measure on the discrete cube. Functions with a low 
Fourier weight on the high levels are discussed in Section [3l We conclude the paper with 
an easy proof of a weaker upper bound on the entropy, and with a connection between the 
entropy/influence conjecture and Friedgut's characterization of functions with a low total in- 
fluence [7J in Section m 
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2 Entropy /Influence Conjecture for the Product Measure jip on 
the Discrete Cube 



In this section we consider the space {0, 1}^ , for < p < 1. First we formulate a variant of the 
entropy /influence conjecture for the biased measure and prove that it follows from the original 
conjecture. Then we show that it is tight for the graph property of containing a copy of a 
complete graph Kr as an induced subgraph, for random graphs distributed according to the 
model G{n,p), at the critical probability pc- 

Proposition 2.1. Assume that the entropy /influence conjecture holds. Then there exists a 
universal constant c such that for any < p < 1, for any n and for any f : {0, l}p — )• { — 1, 1}, 
we have 

Entp(/)<cplog(l/p)-Ip(/). 

Our proof is based on a standard reduction from the biased measure fj,p to the uniform 
measure /ii/2 first considered in [1]. Let p < 1/2, and assume that p = t/2™H For any 
function / : {0, 1}" — > R we define a function Red{ f ) = g : {Q, l}'"" — ;> M as follows: each 
y € {0, 1}'"" is considered as a concatenation of n vectors G {0, 1}™, and each such vector is 
translated to a natural number < Bin{y^) < 2*" through its binary expansion (i.e., Bin{y^) = 
ET=o 2^' • vL-j)- Then, for any y G {0, 

g{y) = 9{y\y\ • • • , y") := / W)Mv^), • • • , Ky^)) , 

where h : {0, 1}*" — )■ {0, 1} is given by 



h{y' 



1, Bin{f)>T^-t 
0, 5m(y*) -t. 



We use two simple properties of the reduction. The first, proved by Friedgut and Kalai [8], 
relates the total influence of g (w.r.t. ^1/2) to that of / (w.r.t. to pip). 

Lemma 2.2 (Friedgut and Kalai). Let f : {0, 1}^ — )• { — 1, 1}, and let g = Red{f). Then 

11/2(5) < 6pLlog(l/p)JIp(/). (2) 

The second property relates the Fourier coefficients of / (w.r.t. fip) to corresponding coef- 
ficients of 51 (w.r.t. /^i/2)- 

Lemma 2.3. Let f : {0, 1}^ — t- M, and let g = Red{f). For any S C {1,2, . . . ,mn}, denote 
Si = S n {{i — l)m + 1, (« — l)m + 2, . . . , im}, and for S" C {1, 2, . . . , n}, let 

V{S') = {S C {l,2,...,mn} : {i : \Si\ > 0} = S'}. 

E 9iSf = f{Sr. (3) 

S£V{S') 



^It is clear that there is no loss of generality in assuming that p is diadic, as the results for general p follow 
immediately by approximation. 
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Proof: For each S' C {1,2,... ,n}, let fs' : {0,l}p ^ M be defined by fs' = f{S')us'. We 
claim that 

Red{fs')= 9{S)us. (4) 

sev{s') 

This claim implies the assertion, as by the Parseval identity. Equation @ implies: 

^ giSf = \\Red{fs>)\\l = \\fs'\\l = hS'f. 
sev{s') 

(The first and third equalities use the Parseval identity, and the middle equality holds since by 
the structure of the reduction, it preserves all Lp norms.) 

In order to prove Equation we use Proposition 2.2 in [12j that describes the exact relation 
between the Fourier coefficients of Red{f) and the corresponding coefficients of /. By the 
proposition, for all S G V{S'), 

IUd{f)iS)=c{S,p)-f{S'), 

where c{S,p) depends on S and p but not on /. Hence, for all S G V{S'), we have Red{fs'){S) = 
Red{f){S) (since both are determined by S,p, and f{S')). Similarly, for all S V{S'), 
Red{fs'){S) = 0, since fs'iS") = for all S" ^ S' . Therefore, the Fourier expansion of 
Red{fs') is: 

Red{fs')= Yl R^)iS)us, 
sevis') 

as asserted. □ 

Now we are ready to prove Proposition 12.11 

Proof: Let / : {0, 1}^ {-1, 1}, and let g = Red{f). By Equation 



Entv2(5)= E 9iSflog-L-= Y E ^(^)'l°g57^ 

Sc{l,2,...,mn} ^ 5'c{l,2,...,n}SeV(5') ^ 

> E E ^(^)'l°g77^= E /(5')^log^=Ent,(/). 

S'c{l,2,...,n}SGV{S') ■l^'^' 5'c{l,2,...,n} -I ^ 



(5) 



Combining Equation ^ with Equation ([2]) and applying the entropy /influence conjecture to 
g, we get: 

Entp(/) < Enti/2(9) < c • Ii/2(<7) < c • 6p[log{l /p)\lp{f), 

and therefore, 

Entp(/)<c'plog(l/p)Ip(/), 

as asserted. □ 

Consider the random graph model G{n,p). Recall that in this model, the probability space 
is {0, 1}^, where = (2)5 the coordinates correspond to the edges of a graph on n vertices, 
and each edge exists in the graph with probability p, independently of the other edges. It 
is well-known that for the graph property of containing the complete graph Kr as an induced 
subgraph, there exists a threshold at pt = Q{n~'^^^^~^^). This means that if p << n~'^^^^~^^ then 
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PilKr C G\G e G{n,p)] is close to zero, and if p >> n"^/^'" then Fr[Kr C G\G e G{n,p)] is 
close to one. We choose a value po in the critical range, consider the characteristic function / 
of this graph property in G{n,pQ), and show that the assertion of Proposition 12 . 1 1 is tight for /. 
In order to simplify the computation, we choose po such that the expected number of copies of 
in G{n,pQ) is "nice". However, the same argument holds for any value of p in the critical 
range. 

Proposition 2.4. Let n,r be integers such that r < logn. Consider the random graph G{n,pQ) 
where po chosen such that (^) • Pq = 1/2. Let f be defined by: 

f{G) = 1 <^ G contains a copy of as an induced subgraph, 
and f{G) = otherwise. Then 

Entpo(/) > c-polog(l/po) -Ipol/)' 
where c is a universal constant. 

Proof: The result is a combination of an upper bound on Ipo(/) with a lower bound on 
Entp„(/). 

In order to bound Ipo(/) from above, note that a necessary (but not sufficient) condition for 
an edge e = {v,w) to be pivotal for / at a graph G0 is that there exists a set S of r vertices 
including v and w such that all (2) edges inside S except for e appear in G. Hence, a simple 
union bound yields that for any edge e, 

po^n < ^ - 2V JD-i = r{r-l) fn\ il) ^ r{r - 1) 
^^•"-\r-2j ^0 n(n -l)po V^/ 2n(n-l>o' 

and thus, 

e 

In order to bound Entp,)(/) from below, we show that at least a constant portion of the 
Fourier weight of / is concentrated on coefficients that correspond to copies of Kr in {0, 1}^. 
Concretely, we show that if S corresponds to a copy of Kr, then: 

Ksf>c'.(iy\ (7) 

As the number of such coefficients is ("), it will follow that: 

Entp„(/) > Yl ( ) ^ ■ ^ -rlogin), (8) 

{S: S is a copy of Kr} ' / ^''^ 

where the rightmost inequality holds since r < logn. Finally, a combination of Equation ([8]) 
with Equation ([U]) will imply: 

Entp„(/) > c" • rlog(n) > c" • . log(l/po) > c" • po log(l/po) • Ipoif), 



An edge e is pivotal for the property / at a graph G if /(G) = 1 and /(G \ {e}) = 0. 
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as asserted. 

To prove Equation ([7]), consider a specific copy H of Kj- and denote its set of edges by 
S = E{H). By the definition of the Fourier coefficients, we have: 

= /^po(T\S)-(po(l-Po))(^')/'(-l)l^^^l/(T) (9) 

Te{o,i}^ 

HPo{i-Po)p/' E /ipo(r\s)(-i)i^-^i/(r), 

Te{o,i}^ 

where (T\S) denotes the induced measure of the graph T\S. Note that the total contribution 
to f{S) of {T e {0, 1}^ : 5 C T} is 

(-1)1^1 •(po(l-Po))(^)/', (10) 

since f{T) = 1 for all T D S. On the other hand, if f{T) = 1 and T ^ S, then T contains a 
copy of Kr, in which k < r — 1 vertices are included in V{H), and the remaining r — k vertices 
are not included in V{H). Hence, the total contribution to f{S) of {T G {0, 1}^ : S C T} is 
bounded from above (in absolute value) by: 

(po(l - Po)p/' 'Jlir- k) = " ■ ^^/^ + ^^^^ 

/•r\ 

since for our choice of po, the term corresponding to A; = equals (")Po = 1/2, and the other 
terms are negligible. Combining estimates (llOp and (lllh . we get: 

/(5)' > (1 - 1/2 - o„(l))2(po(l -Po))(^) > = (c/2) • (12) 
This completes the proof. □ 

We conclude this section by noting that if p is inverse polynomially small as a function of n, 
then one can easily prove a statement which is only slightly weaker than the entropy /influence 
conjecture. In [14] it was shown that with respect to the uniform measure, we have 

Enti/2(/) < (logn+l)Ii/2(/) + l, 

for any Boolean /. The statement generalizes easily to a general biased measure /ip, and yields 
the following: 

Claim 2.5. There exists a universal constant c such that for any < p < 1, for any n and for 
any f : {0, 1}^ — )• {—1, 1}, we have 

Entpif) < cp{l - p) log(n)-Ip(/). 
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Proof: Assume w.l.o.g. that p < 1/2. As shown in [14j . we have: 

Entp(/) < (logn + 1) \S\f{Sf + elog(l/e) + 2e, 

s 

where 1 — e = /(0)^. (Note that this part of the proof of Theorem 3.2 in [14J holds without 
any change for the biased measure). In order to bound the term elog(l/e) + 2e, it was shown 
in Proposition 3.6 of [H] that by the edge isoperimetric inequahty on the cube, it is bounded 
from above by 2li/2{f)- By Equation this imphes that for the measure fj,p, we have 

elog(l/e) + 2e<12pLlog(l/p)JIp(/) 

(since the reduction from the biased measure to the uniform measure preserves the expectation). 
Thus, by Equation ([T]), 

Entp(/) < (logn+ 1) -4^(1 -p)Ip(/) + 12pLlog(l/p)JIp(/) < cp(l - p) log(n)Ip(/), 

as asserted. □ 

For p that is inverse polynomially smah in n, the statement of Claim 12.51 differs from the 
assertion of the entropy/influence conjecture only by a constant factor. 

3 Functions with a Low Fourier Weight on the High Levels 

In this section we consider the uniform measure fii/2 on the discrete cube, and study Boolean 
functions with a low Fourier weight on the high levels. In order to simplify the expression of 
the Fourier expansion, we replace the domain by { — 1, 1}". As a result, the characters are given 
by the formula 

and thus, the Fourier expansion of a function is simply its representation as a multivariate 
polynomial. 

Proposition 3.1. Let f : { — 1, l}"/2 ~^ such that all the Fourier weight of f is concentrated 
on the first k levels. Then all the Fourier coefficients of f are of the form 

f{S) = a{S)-2~\ 

where a{S) G Z. In particular, Enti/2(/) ^ 2/c. 

Proof: The proof is by induction on k. The case A; = is trivial. Assume that the assertion 
holds for all A; < d — 1, and let / be a function of Fourier degree d (i.e., all its Fourier coefficients 
are concentrated on the d lowest levels). For 1 < i < n, let /* be the discrete derivative of / 
with respect to the ith coordinate, i.e., 

ri/ \ f i^li • • • ) Xi—i, 1, Xi^i ) • • • 5 Xyi) — f [xi, . . . , Xi—i, 1, Xi^i ) • • • 1 Xn) 

J yXi, . . . , Xi—i, XiJf-i, . . . , Xn) — ^ 

It is easy to see that if / = Yls /('S')^^S') then the Fourier expansion of /* is given by: 

f= Yl fiSU{i})us. (13) 

Sc{{l,2,...,n}\{i}) 
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Hence, /* is of Fourier degree at most d — 1. Note that by the definition of we have 
2p{x) E Z for all x E {—1, and thus by the induction hypothesis, the Fourier coefficients 
of /* satisfy 2p{S) = a{S) ■2~'^~^^, where a{S) E Z. This holds for any 1 < i < n, and therefore, 
by Equation p^ . all the Fourier coefficients of / (except, possibly, for /(0)), are of the form 
f{S) = a{S) •2"°', where a{S) E Z. Finally, /(0) must be also of this form, since otherwise f{x) 
cannot be an integer. This completes the proof. □ 



In an unpublished work ^6], Bourgain and Kalai obtained a stronger result: 

Theorem 3.2. Let f : {—1,1}" — )• {—1,1}, and assume that there exist cq > 0, < a < 1/2, 
and k, such that for all t, 

{S:\S\>t} 

then for any a > 1, there exists a set Ba, such that: 

1. log \Ba\ < C ■ ak, where C depends only on a and cq. 
^- Es^BjiSr<n--. 

The theorem asserts that if the Fourier weight of / beyond the kth level decays exponen- 
tially, then most of the Fourier weight of / is concentrated on exp{Ck) coefficients, and thus, 
Enti/2(/) < C'k (for an appropriate choice of C). The proof uses the dth discrete derivative 
of / (like our proof above), and the Bonami-Beckner hypercontractive inequality O [T]. We 
note that the exact dependence of C on a (i.e., the rate of the exponential decay) in the as- 
sertion of the theorem, which is important if a is allowed to be a function of n, is of order 
C = G(a-Mog(a-i)). 

A tensorisation technique. In [flj, Kalai observed that the entropy/influence conjecture 
tensorises, in the following sense. For / : { — 1, l}']^/2 ~^ ^'^^ 9 '■ ~^ {~^^ ^i' 

define f ® g : {-1, l}',^" ^ {"1, 1} by: 

/ ® g{xi, . . . , xi+m) = f{xi, ■■■,xi) ■ g{xi+i, . . . , x/+m)- 

Furthermore, let 



where the tensorisation is performed times. It is easy to see that Ii/2(/'^^) = ^ ■ Ii/2(/) 
and Enti/2(/®^) = N ■ Enti/2(/). Hence, proving the entropy /influence conjecture for any 
"tensor power" of / is equivalent to proving the conjecture for / itself. This observation was 
used in [H] to deduce that it is sufficient to prove a seemingly weaker version of the conjecture: 
Enti/2(/) ^ ^^1/2(1) + o{n), where n is the number of variables. 

We observe that tensorisation can be used to enhance the rate of decay of the Fourier 
coefficients. By the Law of Large Numbers, as — t- 00, the level of the Fourier coefficients 
of is concentrated around its expectation, which is N ■ Ii/2(/); and the rate of decay 

above that level, i.e., X]|5|>t /®"'('S')^ becomes "almost" inverse exponential in t. This holds 
even if the rate of decay of the Fourier coefficients of / is much slower (like the Majority 
function, for which Yl\s\>t ^ i'^)'^ ~ t~^/^). Therefore, if one obtains a result similar to 
Bourgain-Kalai's Theorem 13.21 for a slower rate of decay, e.g., under the weaker assumption 
X]|5|>t fi^)'^ — e'^"^ • e~"^, then the result can be enhanced to any rate of decay, by tensoring 

the function to itself until its rate of decay reaches e~"^. However, we weren't able to find 
such generalization of the Bourgain-Kalai result. 



9 



4 Concluding Remarks 



We conclude this paper with two remarks related to the entropy /influence conjecture. 

A weaker upper bound on the entropy that can be proved easily. As mentioned in 
Section [21 it was shown in [T3] that with respect to the uniform measure, one can easily prove 
the following weaker upper bound on the entropy of any Boolean function: 

Enti/2(/) < (logn + l)Ii/2(/) + l. 
We provide an independent proof of a slightly stronger claim. 
Claim 4.1. For any n and for any f : {0, l}"/2 ~^ have 

n 

Enti/2(/) <Y,h{l\'\f)) < 2Ii/2(/)(logn-logIi/2(/)), 

i=l 

where 

h[x) = —X log X — {1 — x) log(l — x) . 

Proof: As the proof deals only with the uniform measure on the discrete cube, we write Ent(/) 
and I(/) instead of Ent;^/2(/) Ii/2(/) during the proof. 

Let S C {1,2, ... ,n} be chosen according to the Fourier distribution (i.e., Pr[S' = Sq] = 
f{So)'^), and let Xi = l{ie5}. Then by the basic rules of entropy, 

n n 

Ent(/) = H{S) = H{Xi, ...,Xn)< ^^(A,) = ^h{l,{f)), 

i=l 1=1 

thus obtaining the first inequality. Note that if > 0.5, then < 2Ij(/), and 

otherwise, h{Uf)) < -2Ii(/) logIi(/). Therefore, 

1 " 

-Ent(/) <!(/) + J] I,(/)(-logI,(/)) 

1=1 

-■(/)(-|:^i(->o.l->°^'(/)))- 

We note that the expression Ii(/)/I(/)(— logIj(/)/I(/)) is the entropy of the random 

variable Y defined by Pr[y = i] = /!(/) which is supported on {1, 2, . . . , n}, and is therefore 
bounded by log n. We thus conclude that 

^Ent(/) <I(/)(l + logn-logI(/)) 

as asserted. □ 



It is easy to see that the bound using the entropy is stronger in some cases, in particular 
when there is variability in the influences of different coordinates. 

We note that the proof does not use the fact that / is Boolean and indeed it could not 
provide a proof of the Entropy /Influence conjecture, as can be seen, e.g., for the majority 
function, where Ii/2(/) is of order ^/n while Y17=i (/)) order y^logn. 
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Relation to Priedgut's characterization of functions with a low influence sum. hi [7], 

Friedgut showed that any Boolean function / : {0, 1}^ — )• {0, 1} essentially depends on at most 
coordinates, where C{p) depends only on p. The main step of the proof is to show 
that most of the Fourier weight of the function is concentrated on sets that contain one of these 
coordinates. A stronger claim one may hope to prove is that most of the Fourier weight is 
concentrated on at most C{pY^^^ coefficients. Formally, we raise the following conjecture that 
resembles the assertion of Bourgain-Kalai's theorem: 

Conjecture 4.2. For any < p < 1, there exists a constant C{p) > such that for any e > 0, 
for any n and for any f : {—1, 1}^ — )• { — 1, 1}, there exists a set C {0, l}" such that: 

1. \og\B,\<C{p)-l{f), and 

This conjecture is clearly stronger than Friedgut 's theorem and even implies a variant of 
Mansour's conjecture [13] (since as shown in [3], if a Boolean function / can be represented by 
an m-term DNF, then Ii/2(/) = O(logm) ), but it still does not imply the entropy/influence 
conjecture, since the remaining Fourier coefficients (whose total Fourier weight is at most e) 
can still contribute n • e to Enti/2(/)- 
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